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(54) Storage system 

(57) In a data processing system in which main and 
sub disk storage devices 5 : 10 are each under the con- 
trol of individual disk control devices 3, 8, the write 
processing time is reduced by selectively sending data 
according to a command-chaining time between the 
main and sub disk control devices. A section 36 forjudg- 
ing cable length and function of the sub disk control de- 
vice 8 estimates the command-chaining time between 
a pair of main and sub disk storage devices. A channel 



command analysing section 31 estimates the number 
of records to be transferred and the length of a record 
using a LOCATE RECORD command. The command 
judgement section 32 for the sub disk control device 8 
optimises the command chain to be issued to the sub 
disk control device using the above information. A com- 
mand issuing section 35 then issues the optimised com- 
mand chain to the sub disk control device 8. Thus, a 
shorter transmission time is realised by sending either 
individual records or an entire track of data. 
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Description 

FIELD OF THE INVENTION 

[0001] Present invention relates to an external stor- 
age control device which stores data to an external stor- 
age device according to a write command from a host. 
In particular, the present invention relates to a system 
in which the same data is copied to another external 
storage device. 

BACKGROUND OF THE INVENTION 

[0002] When data used in a host are stored to plural 
external storage devices, main and sub external storage 
devices that hold the same data are sometimes provid- 
ed under individual eternal storage control devices. In 
this case, these external storage control devices ate 
mutually connected, and the main external storage con- 
trol device issues a write command to the external stor- 
age control device which controls sub external storage 
devices when the external storage control device which 
controls main external storage devices receives a write 
command. Thus, data stored in the main and sub exter- 
nal storage devices are duplicated. 
[0003] US 5,155,845 A discloses a method in which 
an external storage control device which controls main 
external storage devices and one which controls sub ex- 
ternal storage devices are mutually connected. A main 
external storage control device which has received a 
write command from a host, transfers data to a sub ex- 
ternal storage control device. Thus, the write process in 
performed in parallel for both of main and sub external 
storage devices. 

[0004] DE 39 35 235 A discloses a storing method for 
microcomputer systems in which data are transferred 
between a central processor and a storage medium at 
high transfer rates by concatenating data to from com- 
posite packets, thereby minimising transmission time. 
[0005] WO 94/1 9748 discloses a method of transfer- 
ring data in blocks among computer input/output devic- 
es with the blocks being continually re-sized during 
transfer. 

[0006] EP-A-0 601 738 describes a system in which 
data blocks are buffered during their transfer to a disc 
memory to save transfer time. 
[0007] When a host handles data stored in external 
storage devices with CKD (count, key, data) format as 
used in large scale computer systems, the host issues 
channel commands in succession for instructing data 
transfer of each individual record. Thus, each individual 
record undergoes the same command chaining se- 
quence in order to be transferred. 
[0008] Figure 3 illustrates a case of plural records be- 
ing written using the same command chaining se- 
quence. This Figure illustrates the case in which plural 
records are written in succession by a single command- 
chaining. In an external storage sub system having main 



and sub external storage devices that hold the same da- 
ta, located under individual external storage control de- 
vices, when a channel device that is a host issues a 
command-chain (DEFINE EXTENT / LOCATE 

5 RECORD / WRITE(R1 ) / WRITE(R2) / WRITE(R3)) to 
write 3 successive records R1 , R2, and R3 to a disk stor- 
age device that is a main external storage control de- 
vice, data flow between the channel device and the main 
external storage control device and between the main 

10 external storage control device and the sub external 
storage control device are shown in the processing se- 
quences of Figure 3. Thus, several command-chains 
between the main and sub external storage control de- 
vices for each data transfer of write records is executed. 

is [0009] Further, in case data is duplicated by adopting 
the system described above, the distance between main 
and sub external storage control devices becomes large 
considering the backups necessary in case of a disaster 
Thus, an optical fibre cable is adopted as the interface 

20 cable. Accordingly, the influence of cable delay, which 
is considered to be constant for a metal cable, with re- 
spect to command-chaining time cannot be ignored. 
However, since this duplication is for back up purposes, 
the influence of the write process for the sub external 

25 storage control device during an ordinary process must 
be minimised. 

[0010] In a case where the write command must.be 
executed a number of times in accordance with the com- 
mand-chaining described above, this command-chain- 

30 jng time required for writing to sub external storage con- 
trol devices cannot be ignored. This is because the 
amount of command-chaining between main and sub 
external storage control devices increases. As a result, 
backup processing can severely decrease the through- 

35 put rate in ordinary processing. 

SUMMARY OF THE INVENTION 

[0011] Thus, one purpose of present invention is to 

40 optimise the write process time for the sub external stor- 
age control device by taking into consideration the com- 
mand-chaining time between main and sub external 
storage control devices. As a result, the present inven- 
tion offers a means for achieving excellent performance 

45 even under the conditions explained above. 

[0012] In order to achieve the above-mentioned pur- 
pose, the external storage control device according to 
present invention is equipped with a means for estimat- 
ing command-chaining time between main and sub ex- 

so ternal storage control devices. There is also provided a 
means for estimating the time for a write process to a 
sub external storage control device before starting the 
write process to the sub external storage control device. 
The command is issued to the main external storage 

55 control device from the host. The present invention also 
includes means to select the best suited command- 
chaining method, Thus, a comparison is made between 
the above-mentioned estimated time with the data 
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processing time required in the case of transferring data 
for a write record or data of plural tracks including a write 
record in one operation using a specified command. The 
present Invention also includes command means for 
writing said data in a single operation. 5 
[0013] It Is possible for an external storage device to 
learn of the command-chaining time mentioned above 
by either measuring the command-chaining time from a 
specified command to the next command, or by setting 
the length of interface cable between main and sub ex- io 
ternal storage control devices from outside In advance. 
On the other hand, the time required for a write process 
for the sub external storage control device can be cal- 
culated by the above-mentioned information and by the 
information included in the command issued to the main *s 
external storage control device. Namely, command- 
chaining used for data input/output includes at least two 
specific channel commands prior the command to start 
data transfer. For example, for an external storage con- 
trol device, the commands, "DEFINE EXTENT" and 20 
"LOCATE RECORD", are issued prior to data transfer, 
and the number of records to be processed and the data 
length are given so that the amount of data to be trans- 
ferred can be calculated. 

[0014] Furthermore, the command-chaining time be- 25 
tween main and sub external storage control devices 
depends upon length of interface cable and the perform- 
ance of the external storage control device, and does 
not depend on commands made before and after the 
command-chaining. Accordingly, command-chaining 30 
time during data transfer can be estimated by measuring 
the time for two command chains. Also, the length of 
interface cable between main and sub external storage 
control devices, and support functions of a given exter- 
nal storage control device are known at the time of in- 35 
stallation of a backup system. Thus, command-chaining 
time can be estimated with the length of interface cable 
as established. 

[001 5] Since the command-chaining time can be es- 
timated as mentioned above, the processing time can *o 
also be estimated for a given amount of data transfer in 
the case that the command-chaining command from the 
channel device Is issued to the sub external storage 
control device! Consequently, by comparing this 
processing time with a processing time in the case of 45 
transferring data for a write record, or, data of plural . 
tracks including a write record together, using a com- 
mand and command means to write said data at once, 
the best suited command-chaining instruction can be is- 
sued to the sub external storage control device. so 
[0016] Also, the external storage control device ac- 
cording to present invention is equipped with means to 
confirm that the object data exists in the data buffer of 
another external storage control device in order to trans- 
fer data from the data buffer within the external storage ss 
control device to an external storage control device that 
receives the write commands, in addition to data trans- 
fer means as mentioned above. Moreover, the process- 



ing time can be further reduced by transferring all the 
physical data together, including the control byte and the 
check byte in the data buffer. 
[001 7] Additionally, in case where object data for the 
read command, received from the host, exists in the 
buffer of an external storage control device other than 
the external storage control device which has received 
the read command, the processing time for performing 
a read-out can be shortened by transferring these data 
to the external storage control device which received the 
read command instead of accessing the other external 
storage device. 

[0018] These and other objects, features and advan- 
tages of the present invention will become more appar- 
ent in view of the following detailed description of the 
preferred embodiments. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0019] 

Figure 1 illustrates a configuration of the data 
processing system according to an embodiment of 
the present invention. 

Figure 2 illustrates a configuration of the main disk 
control device according to an embodiment of the 
present invention. 

Figure 3 illustrates the data flow between the chan- 
nel device, that is a host, the main disk control de- 
vice, and the sub disk control device. 
Figure 4 illustrates the data flow in the case that da- 
ta are transferred between the main and sub disk 
control devices record by record or in an entire 
track. 

Figure 5 illustrates data format in the data buffer of 
a disk control device for the case of 8 records per 
track. 

Figure 6 illustrates a graph showing the relation be- 
tween number of records transferred and the 
processing time. 

Figure 7 illustrates a flow chart representing steps 
followed according to an embodiment of the present 
invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0020] The preferred embodiments of the present in- 
vention will now be described in conjunction with the Fig- 
ures. Figure 1 illustrates a configuration diagram of data 
processing system according to an embodiment of the 
present invention. This data processing system includes 
a main memory device 1 , a channel device 2, a backup 
system 6 and a channel device 7. This data processing 
system also includes a main disk control device 3 
equipped with a buffer memory 4, and a main disk stor- 
age device 5, and also includes a sub diskcontrol device 
8 equipped with a buffer memory 9, and a sub disk stor- 



3 



5 



EP 1333 371 A2 



6 



age device 4. The channel device 2 Is connected to the 
main disk storage control device 3 through an interface 
cable 11 , the main disk storage control device 3 is con- 
nected to the sub disk storage control device 8 through 
an interface cable 12. Interface cables are also used to 
interconnect other elements shown in this Figure. Pref- 
erably, optical fibre cables are used as the interface ca- 
bles. 

[0021] As shown in Fig. 2 the main disk control device 
3 includes a channel command analysing section 31 , a 
command judging section for judging commands to be 
issued to the sub disk control device 32, a management 
information table for the sub disk control device 33, a 
timer 34, a command issuing section for the sub disk 
control device 35, and a section for interpreting cable 
length and the function of the sub disk control device 36. 
Function blocks 31 33, 35 36 are realised by a micro- 
program executed by a microprocessor contained in the 
disk control device 3. Timer 34 is a hardware counter 
that is counted up according to a constant period. The 
sub disk control device 8 is constructed similarly to main 
disk control device 3. 

[0022] The command-chaining time required be- 
tween main and sub external storage control devices is 
measured in the main disk control device 3, by using the 
timer 34, the section for issuing command to the sub 
disk control device 35, and the section for interpreting 
cable length and function of the sub disk control device 
36. Then, the command chaining time, Tsg, is measured 
when a command is processed once a pair of main and 
sub disk storage devices are established. The measur- 
ing is performed by timer 34 and is stored in the man- 
agement information table 33 in the main disk control 
device 3. 

[0023] The main disk control device obtains support 
function level information of the sub disk control device 
when the pair of main and sub disk storage device is 
established. This function level information is stored in 
the management information table of the main disk con- 
trol device. This stored information is used to judge 
whether a write command to write data for write record, 
or, data of plural tracks including the write record can be 
accepted by sub disk storage control device or not. 
[0024] If command judgement section for the sub disk 
control device 32 has judged from the support function 
level information that a specified command is not ac- 
ceptable, when a write command is received from the 
channel device 2, the section for issuing command to 
the sub disk control device 35 unconditionally issues a 
command-chain sent from the channel device to the sub 
disk control device. Thus, the system is rendered more 
versatile in that it can connect even with a conventional 
device that does not support these functions. 
[0025] The channel command analysing section 31 
operates as follows. When the channel device 2 issues 
a write command to the main disk control device 3, the 
channel command analysing section 31 determines 
whether or not the write command is for a disk storage 



device that forms a pair with the main disk control device 

3. 

[0026] Figure 6 is a graph illustrating command- 
chaining time for two separate cases. One case corre- 

5 sponds to the processing time required when data for 
one track including a write record. The information from 
the management information table for the sub disk con- 
trol device 33 is used, as is the number of transfer 
records of LOCATE command, the number N which is 

10 analysed by the channel command analysing section 
31 , and average record length, L. Here, the straight line 
(II) can be explained by an equation as shown below 
using known values of command chaining time Tsg be- 
tween the main and sub external storage control device, 

* 5 the above analysis, and the data transfer velocity V be- 
tween the main and sub external storage control devices 
3 and 8. 

20 : Ts = NLyV+(N-1)Tsg (1) 

[0027] The straight line (II) shows the transfer time Ts\ 
which is a constant value, for the case where data of 
one track is transferred together and where each record 
25 length is L, and number of records in a track is Na. Ts* 
can be represented by the following formula.: 

Ts' = NaL/V+Tsg (2) 

30 

[0028] In the case of the sloped line (I), as the number 
of records increases, the processing time increases. At 
some point, i.e. for some number of records, it is faster 
to send the entire track of data, because the command 

35 chaining time Tsg is too great. 

[0029] The section for judging commands to be is- 
sued to the sub disk control device 32 judges whether 
to issue the command chain to the sub disk control de- 
vice as received from the channel device or to transfer 

40 data of one track all together based upon the information 
contained in Figure 6, in view of the number of records 
N. 

[0030] Figures 5 and 6 illustrate a case in which six 
records are to be written in a track that holds eight 

45 records of data. As seen from Figure 4, transferring data 
of one track all together requires less processing time if 
the number of record is greater than 4. Figure 6 also 
illustrates such a relationship according to the intersec- 
tion of lines I and II. Command issuing section 35 issues 

50 the best suited command-chain to the sub disk control 
device 8, in view of all of the considerations mentioned 
above and according to the instruction of command 
judgement section 32. 

[0031] Figure 3 illustrates command chaining be- 
55 tween a CPU (channel device or host) and a sub disk 
controller via a main disk controller. As shown, a number 
of commands have to be sent back and forth before a 
record (R1) can be transmitted. The same sequences 
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is followed for subsequent records. 
[0032] According to the present Invention, write 
processing time to a sub disk storage device, i.e. back- 
up processing time, can be minimised by selecting a 
command-chain method to be issued to the sub disk 5 
control device. This is accomplished by comparing 
processing time for the case of issuing the command 
chain to the sub disk control device as received from the 
channel device with that of the case of transferring data 
for a write record, or, data of plural tracks including a 10 
write record all together. 

[0033] Figure 7 illustrates the flow of steps according 
to the present invention. First, the amount of data that 
is to be sent is calculated (STEP 100), i.e. the number 
of records. Then a time T1 is calculated (STEP 110). T1 '5 
is equal to Ts using equation (1 ) above, and is computed 
for the case of sending individual records. Then, a time 
T is calculated (STEP 120). T2 is equal to Ts using equa- 
tion (2) above, and is computed for the case of sending 
the entire track of data. In decision block 130, it is de- 20 
termiried if T1 >T2 (STEP 1 40). If so, then the entire track 
of data is sent (STEP 140). If not, then the individual 
records are sent separately (STEP 150). This process 
is repeated as necessary. 



Claims 

1 . A storage system comprising: 

30 

a first plurality of disk drives (5) and 
a first disk controller (3) connected to a host 
processor (2) and said first plurality of disk 
drives (5) for controlling the data transfer be- 
tween said host processor (2) and said first plu- 35 
rality of disk drives (5), 

wherein said first disk controller (3) is con- 
nected to a second disk controller (8) and obtains 
information on a support function of the second disk *o 
controller (8). 

2. The system of claim 1 , wherein said first disk con- 
troller (3) issues to the second disk controller (8) in- 
formation that is different according to the support *5 
function of the second disk controller (8). 

3. The system of claim 2, wherein said first disk con- 
troller (3) acts according to a first support function 

of the second disk controller (8) if the second disk so 
controller (8) has the first support function. 

4. The system of claim 2, wherein said first disk con- 
troller (3) issues to the second disk controller (8) in- 
formation that does not correspond to second sup- 55 
port function, if the second disk controller (8) does 

not have the second support function. 



5. The system of claim 2, wherein said first disk con- 
troller (3) includes a function determining section for 
judging the support function of the second disk con- 
troller (8). 

6. The system of claim 1 or 5, wherein said first disk 
controller (3) includes a management table for stor- 
ing the information on the support function of the 
second disk controller (8). 

7. The system of claim 1 or 6, wherein said first disk 
controller (3) further includes means for obtaining 
the information on the support function of the sec- 
ond disk controller (8) from the second disk control- 
ler (8). 

8. The system of claim 7, 

wherein said first disk controller^) establish- 
es a pair of said first plurality of disk drives (5) and 
a second plurality of disk drives (10) controlled by 
the second disk controller (8), and I. 

wherein said first disk controller (3) obtains 
the information on the support function of the sec- 
ond disk controller (8) from the second disk control- 
ler (8) when the pair of said first and second disk 
drives (5, 10) is established. 

9. The system of claim 7, wherein said first disk con- 
troller (3) stores in said management table the in- 
formation on the support function of the second disk 
controller (8) and obtained from the second disk 
controller (8). 

10. The system of claim 9 as dependent on claim 5, 
wherein said first disk controller (3) uses the infor- 
mation on the support function of the second disk 
controller (8) in said management table so that said 
function determining section judges the support 
function of the second disk controller (8). 

11. The system of claim 2, wherein said first disk con- 
troller (3) does not issue a specified command to 
the second disk controller (8), if said first disk con- 
troller (3) judges from the information on the support 
function of the second disk controller (8) that the 
second disk controller (8) cannot accept the speci- 
fied command. 

12. A storage system comprising: 

a first plurality of disk drives (5) and 
a first disk controller (3) connected to host proc- 
essor (2) and said first plurality of disk drives 
(5) for controlling the data transfer from said 
first plurality of disk drives (5) to said host proc- 
essor (2), 

wherein said first disk controller (3) is con- 
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nected to another storage system and transfers a 
read command received from the host processor (2) 
to the other storage system, in the case where ob- 
ject data for the read command exist in the other 
storage system. 5 

13. The system of claim 12, 

wherein said first disk controller (3) controls 
the writing of data from said host processor (2) to 
said first plurality of disk drives (5), and io 

wherein said first disk controller (3) includes 
means for confirming that object data for the read 
command or a write command received from the 
host processor (2) exist in the other storage system, 
and means for transferring the read or write com- 
mand from first disk controller (3) to the other stor- 
age system. 



14. A storage system comprising: 



20 



a first plurality of disk drives (5), and 
a first disk controller (3) connected to said first 
plurality of disk drives (5) for controlling the data 
transfer between said host processor (2) and 
said first plurality of disk drives (5), 25 

wherein said first disk controller (3) is con- 
nected to a second disk controller (8) which sup- 
ports another function against said first disk control- 
ler (3). 30 



35 



40 



45 



50 



55 



6 



EP 1 333 371 A2 



MAIN MEMORY DEVICE 



BACKUP SYSTEM 



CHANNEL DEVICE ^2 



CHANNEL DEVICE 



11 



MAIN DISK CONTROL 
DEVICE 



J 3 



BUFFER MEMORY 



,4 12 

yi i. 

I INTERF/ 



INTERFACE 
CABLE 



12 



8 



SUB DISK CONTROL 
DEVICE 



BUFFER MEMORY f "~9 



MAIN DISK 
STORAGE 
DEVICE 



SUB DISK 
STORAGE 
DEVICE 



10 



FIG. 1 



7 



EP 1 333 371 A2 




8 



EP 1 333 371 A2 



CPU 



MAIN DISK 
CONTROLLER 



SUB DISK 
CONTROLLER 



CMD(DX) 



CMD RESP 



ACPTRESP 



DATA 



1> 



STATUS 



CMD(LOC) 



CMD RESP 



DATA 



STATUS 



CMD(wR R^ 



CMD RESP 



DATA y 



STATUS 



CMD(DX) 
CMbRESP 



ACPT RESP 



DATA 



STATUS 



CMD(LOC) 



QMP Rpsp 



DATA 



STATUS 



CMD(wR R^) 



DATA 
STATUS 



WRITE 
PROCESS 
OF R 2 AND 
R 3 ARE 
EXECUTED 
BY THE 
SAME 
SEQUENCE 



FIG. 3 



9 



EP 1 333 371 A2 



ID 
O 

\r> 

S2o 
coO 

Z 

o 
o 



HI 

o 
o 



UJ 

o 
go 

cqO 

8 



(11 
ZO 

8 



CO 


Q_ 


CO 




UJ 

DC 


g 


Q 




2 




o 



1IAAAAAAAA 



< 
Q 



< 
D 



a 

2 
O 






Q. 


a. 




CO 


CO 


CO CO 


CO 




UJ 


3 UJ 


3 


J— 


ac 




1- 


i* 

CO 


MD 


f o 
co 5 


■ STA 






o 



"A 



iS 

< 



A 



7\ 



A 



7T 



7V 



CO 
Q 

ir< 

OP 

o< 

UJO 

co 



o 

2 

o 



o 

O 



10 



EP1333371 A2 



1 TRACK 



✓ 














«7 


"8 





WRITE RECORD 

FIG. 5 




RECORD NUMBER N 

FIG. 6 



11 



EP 1 333 371 A2 



DETERMINE 
AMOUNT OF DATA = 
TO BE SENT 



# OF RECORDS 



DETERMINE TOTAL TIME FOR 

SENDING INDIVIDUAL 
RECORDS TO SPECIFIED SUB 
SYS INCLUDING CCT (T1) 



DETERMINE TOTAL TIME TO 
SEND ENTIRE TRACK OF DATA fVi20 
TO SPECIFIED SUB SYS (T2) 



130 




YES. 



140 



SEND ENTIRE 
TRACK OF DATA 



SEND INDIVIDUAL 
RECORDS 
SEPARATELY 



"V-150 



FIG. 7 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 



Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 



□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: : ■ 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



BEST AVAILABLE IMAGES 




